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Part I of this paper dealt with various idealized transmission characteris- 
tics and with methods of evaluating pulse distortion resulting from various 
system imperfections. In Part II the resultant transmission impairments or 
limitations on pulse transmission rates are discussed for systems with low- 
pass, symmetrical band-pass and asymmetrical band-pass characteristics, 
and a comparison made of the transmission performance of double and 
vestigial sideband systems. The limitation on channel capacity imposed by 
random imperfections in the transmission-frequency characteristic, as com- 
pared to random noise, is also discussed. 

12. IMPULSE CHARACTERISTICS AND PULSE TRAIN ENVELOPES 

In pulse modulation systems pulses are transmitted in various com- 
binations to form pulse trains, and at the receiving end the envelope of 
the pulse train is sampled at regular intervals to determine the ampli- 
tudes of the transmitted pulses. As a result of pulse overlaps there may 
be appreciable distortion of the pulse train envelope, which may cause 
errors in reception or noise, depending on the type of system. To evalu- 
ate transmission impairments, or limitations imposed on transmission 
capacity to avoid excessive transmission impairments from pulse dis- 
tortion, it is necessary to establish basic relations between the impulse 
characteristic of the system and the envelope of the received pulse train. 

In Fig. 42 are shown three transmitted pulses of different peak ampli- 
tudes, A-i , Aq and Ai , transmitted at intervals r with the first and third 
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pulse overlapping into the middle pulse. The instantaneous amplitude 
of the received train at a time k referred to the peak amplitude of the 
middle pulse is 



W(to) = A-iP(U> - t) + AoP(to) + AtPito + r), 
= Z A n P{U + nr). 



(12.01) 



n— 1 



When the sequence of pulses transmitted at uniform intervals t extends 
between n = — <» and ■» , the instantaneous amplitude of the pulse 
train at time to is 



W(t ) = •£ A n P(to + nr). 



(12.02) 



The above equation gives the instantaneous value W(t ) for any se- 
lected combination of transmitted pulses. The transmitted pulses may 
have any value within certain limits, as when they represent signal 
samples in a pulse amplitude modulation system, or may assume two or 
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W(t) = A.,PCt+r)+A P(t) + A 1 P(t-r) 

Fig. 42 — Formulation of expression for pulse train envelope in terms of im- 
pulse characteristic and amplitudes of transmitted pulses. 
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more discrete values as in pulse code modulation systems. In pulse posi- 
tion modulation, A„ = except at the instants pulses of a given ampli- 
tude are transmitted, and n may not necessarily be an integer. In pulse 
duration modulation, A n = 1 over the intervals m of varying duration 
in which pulses are transmitted, and zero otherwise. Equation (12.02) 
is thus a general formulation of the wave shape of a received pulse train, 
applicable to various pulse modulation methods. 

Inserting (2.09) in (12.02) with R- + R+ = R and Q- - Q+ = Q 
and taking \f/ r = without loss of generality 

CO 

= 23 A„[cos o) r (U + nT)R{to + nr) + sin w r (f + nr)Q(^o + nr)], 

n=— oo 

so 

= cos co r / 23 A n [cos oirnrRiU + nr) + sin u r riTQ(U> + nr)] 

oo 

+ sin co r to 23 A„[cos u> r nrQ(/o -f- nr) — sin oi r riTR(to + nr)]. 

—eo 

The envelope of the wave at the sampling instant t = is 

F(0) = (R 2 + Q 2 ) 1/2 , (12.04) 



(12.05) 



R = 23 -4n[cos u T nTR(nT) + sin WfWrQ(»w)], 

— CO 

Q = 23 -^-ntcos co r nrQ(wT) — sin co r nTi2(riT)]. 

—00 

For the particular case of a low-pass system 
Q = 0, and co r = 0, 
so that 

W(0) = 23 A n P(n T ). (12.06) 

n— oo 

A band-pass characteristic can be obtained with the aid of band-pass 
filters at the transmitting or receiving ends, or at both ends of a system, 
and the equations developed previously for the impulse characteristic 
tacitly assumed such an arrangement. Equivalent performance can, 
however, also be secured by methods which are usually employed in 
practice, and to which the equations also apply. Impulses can thus be 
applied to a low-pass pulse shaping network or filter, and the output used 
to modulate a carrier. There will then be a symmetrical distribution of 
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sidebands with respect to the carrier, equivalent to a band-pass charac- 
teristic, with the spectrum of the sideband frequencies determined by 
the characteristic of the low-pass filter. The equivalent of an asymmetrical 
band-pass characteristic can be obtained by suppressing part of the upper 
or lower sideband with the aid of niters. 

Although the mathematical formulation with both methods is es- 
sentially the same when w r is identified with the carrier frequency w c , 
with impulse excitation the phase of ta t is fixed in relation to the envelope 
but is independent of it with carrier modulation. By proper choice of 
the pulse interval r in (12.03), such that cos a> r (t + nr) = cos o) T t or 
u t t = 2irm, m = 0, 1, 2 • • • it is possible with impulse excitation to 
obtain the same relation between the reference or carrier frequency as 
when the output of a low-pass filter is used to modulate a carrier. In the 
above case the pulses are transmitted at intervals r = m/f T = m/f e , 
corresponding to multiples of the duration of a carrier cycle. Since the 
duration of a carrier cycle is ordinarily small in relation to the pulse 
interval, there is essentially no important difference in the rate at which 
pulses can be transmitted with the above two methods." However, with 
band-pass filters the exact relationship of pulse intervals to the carrier 
frequency may be difficult to maintain with simple instrumentation, 
while this is no problem with carrier modulation. For this reason, and 
since the performance is otherwise equivalent, only the basic relation- 
ships with carrier modulation will be discussed further. 

Assuming that cos w r (/ + nr) = cos ujo , as discussed above, equa- 
tion (12.03) becomes 

W(to) 

= cos co r * Z) AJUM + nr) + sin a> T t f) A n Q{U + nr). (12.07) 
The envelope at the sampling point is accordingly 

(r oo -|2 I - oo -|2\ 1/2 

g A n R(nr)j + |jC A n Q(nr) J . (12.08) 

In ideal transmission systems there would be no pulse overlaps or 
intersymbol interference, and the amplitude of the pulse train at the 
sampling instant would be 

F(0) = A [R 2 (0) + Q 2 (0)] 1/2 . (12.09) 

This condition could be realized with sufficient pulse spacing. However, 
the objective in the design of efficient pulse systems is to determine the 
minimum pulse spacing consistent with tolerable intersymbol inter- 
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ference and thus the maximum transmission capacity or optimum per- 
formance in other respects for a given bandwidth. In the following sec- 
tions this problem is discussed further. 

13. TRANSMISSION LIMITATIONS IN SYMMETRICAL SYSTEMS 

In a symmetrical system the amplitude characteristic has even sym- 
metry and the phase characteristic odd symmetry with respect to a 
properly chosen frequency. A low-pass transmission system is thus 
symmetrical with respect to zero frequency, when the negative fre- 
quency range is included. A double sideband system is symmetrical if 
the amplitude characteristic has even and the phase characteristic odd 
symmetry with respect to the mid-band frequency. 

Equation (12.06) applying to a low-pass system or baseband trans- 
mission may be written 

00 

W(0) = A P(0) + £ [A n PM + A-JP(-nr)]. (13.01) 

n-l 

Let it be assumed that pulses of varying but discrete amplitudes are 
transmitted, with a maximum peak amplitude equal to A max and a 
minimum peak amplitude A min . If g pulse amplitudes are employed, 
the difference between peak amplitudes is then (A max — A mi „)/(q — 1). 
Let P designate positive values of P(nr) and P~ the absolute value of 
negative amplitudes. 

The maximum value of W(0) when a pulse of amplitude A is trans- 
mitted at the sampling point n = is then 

W m „ = AoP(O) + £ A max [P + (nr) + P + (-nr)) 

(13.02) 
- Z AraiAP'M + P-(-nr)] 

n-l 

The minimum amplitude of W(0) when a pulse of the next higher am- 
plitude A Q + (Amax — A min )/(q — 1) is transmitted becomes 

W mia = (a + Am » ~ ] Amin ) P(0) 



- 2 A ™« I p M + P~(-n T )] (13.03) 

n-l 

+ f) A -ia [P + (nr) + P + (-ut)]. 

n-l 

To permit distinction between the two pulse peaks it is necessary that 
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PTmin be greater than W max . The difference M = W miB - W mB x , 
which represents the margin for distinction between pulse amplitudes, 
becomes 

M = Amax " ^ min P(0) - (A max - A min ) Z [P + M (13 04) 

+ p-(nr) + P + (-nr) + P"(-nr)], 



or : 



(13.05) 



M = (A max - Amn) [-^ - Z I PM | + | P(-nr) |1 
Lg — i n=i j 

where | P(± nr) \ designates the absolute values of the impulse charac- 
teristic. 

Equation (13.05) shows that for a given value of q the margin depends 
on the maximum pulse excursion A maJi — A min and is thus the same with 
A max = 1 and 4 m in = as with 4 ma x = 0.5 and A min = -0.5. As an 
example, equation (13.05) shows that with two pulse amplitudes, q = 2, 
it is possible to distinguish between pulses and spaces, or between posi- 
tive and negative pulses, if the sum of the absolute values of the impulse 
characteristic at all the sampling points, excluding 0, is less than the 
amplitude P(0) of the impulse at sampling point 0. 

The maximum margin against errors is obtained without pulse over- 
laps, i.e. when the summation term in (13.05) is zero, and is 

jtfmax = Umax - A min ) -^ . (13.06) 

q - 1 

The ratio of the margin M as given by (13.05) to the maximum margin 
becomes : 

M/M mm = 1 - ^i 2 I P(nr) | + \P(-nr) |. (13.07) 

This equation may be employed to determine the maximum possible 
pulsing rate for a given impulse characteristic and number of pulse 
amplitudes, obtained when M/M max = 0, or to determine the margin 
for a given pulse transmission rate. An example of the latter application 
is illustrated in Fig. 43, which shows the margin M/M max in per cent, 
obtained when (13.07) with q = 2 is applied to the curves shown in 
Fig. 23 for various degrees of delay distortion. The pulse interval is 
taken as r = l/2/i = l// ma x , where/x is the frequency at the 6 db down 
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point on the amplitude characteristic and / mn x = 2/i . Under this con- 
dition there is no intersymbol interference in the absence of phase dis- 
tortion. 

The above equations apply to peak intersymbol interference, obtained 
by taking the maximum positive and negative values of the summation 
term in (13.01). As discussed in previous sections, certain types of trans- 
mission system imperfections give rise to pulse distortion extending over 
long time intervals, such as fine structure deviations over the transmis- 
sion band, a low-frequency cut-off and pronounced band-edge phase 
deviations. Evaluation of peak intersymbol interference is then rather 
difficult, and a more convenient approximate method is to evaluate 
rms intersymbol interference, which can be related to rms deviation in 
the transmission frequency characteristic by methods discussed previ- 
ously. Peak intersymbol interference may then be estimated by applying 
a peak factor between 3 and 4, depending on the type of transmission 
distortion. 

If Po(m-) designates an ideal impulse characteristic, which is zero for 
n = ±1, ±2 etc., the deviation from the ideal envelope of a pulse 
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Fig. 43 — Margin against excessive peak interference in systems employing 
two pulse amplitudes with intervals between pulses t = t x = l/2/i = 1/fmnx. for 
impulse transmission characteristic as shown in Fig. 23. 
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train may be written 

ATT(O) = W(0) - W (0) = £j A n [P{nr) - P (n T )]. (13.08) 

n— oo 

The rms deviation becomes, with AP(rn-) = P(nr) — Po(nr) 

/ oo \l/2 

ATT(O) = 4 (Z [APM]M , (13.09) 

& A (i J_ "[AP(0P *) 2 , (13.10) 

= AP(0)17. (13.11) 

4 is the rms amplitude of the transmitted pulses and U the rms inter- 
symbol interference referred to unit amplitude of the received pulses. 
Expressions for U applying to fine structure imperfections in the trans- 
mission frequency characteristic were given in Section 8, for a low-fre- 
quency cut-off in Section 9 and for band-edge phase deviations in Sec- 
tion 10. 

For balanced pulse systems employing positive and negative pulses, 
rms intersymbol interference in the positive and negative directions will 
be equal. For such systems the maximum value of the summation in 
(13.02) becomes kW(0) and in (13.03) -kW(0), where k is the peak 
factor. Equation (13.04) is then replaced by 



M = — ^ P(0) - 2kAP(0) U, 

q - 1 

= 2A max P(0) \—^- - kU(A/A mBI ) 
I a — 1 



'' (13.12) 



'max 



when A m \ D = — A, 

In a balanced pulse system employing q pulse amplitudes, i.e., q/2 
positive and q/2 negative amplitudes, with equal steps 2A max /(q — 1) 
between pulse amplitudes, the following relation applies if all ampli- 
tudes have equal probability. 

4M~ - [a^I- < 1313) 

Hence, 

r.l^W>[i- 1 (^l)* g ], 03.14) 

As mentioned before, the factor k may be as high as 4, in which case the 
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maximum tolerable rms intersymbol interference U referred to unit peak 
amplitude of the received pulses becomes for M = 0: 



q = 2 
U = 0.25 



4 
0.112 



0.054 



In (13.14) and in the above table, U is the maximum tolerable rms 
intersymbol interference from all sources, such as fine structure imper- 
fections over the transmission band, band-edge phase distortion and a 
low-frequency cut-off. Interference from these various sources may be 
combined on a root-sum-square basis. 

In the above evaluation of rms intersymbol interference a balanced 
pulse system was assumed. An unbalanced system can be obtained by 
superposing on a balanced system an infinite sequence of pulses of equal 
amplitude and polarity at uniform intervals as indicated in Fig. 44. This 
superposed system will give rise to a fixed intersymbol interference or 
displacement of the received pulse train, which does not alter the margin 
for distinction between pulse amplitudes and which can be corrected by 
a fixed bias at the receiving end if necessary. For this reason, in the case 
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Fig. 44 Derivation of an unbalanced from a balanced pulse train by super- 
position of an infinite train of pulses of equal amplitude. 
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of an unbalanced system, only the balanced component need to be con- 
sidered in evaluating rms intersymbol interference, which will thus be 
the same whether or not the system is balanced. As shown previously, 
peak intersymbol interference, or the margin for distinction between 
pulse amplitudes, depends only on the peak to peak pulse excursion and 
is thus the same for unbalanced as for balanced systems. It may be 
noted here that for a balanced system the transmitted power is a mini- 
mum for a given margin in pulse reception, as is the interference in other 
systems that may be caused by the transmitted pulses. 

For a symmetrical band-pass system, rather than a low-pass system 
as discussed above, Q{m) = in (12.08). The envelope of the pulse 
train then becomes 

W(0) = E A n R(nr), (13.15) 

n= — oo 

where R(nr) = R-(nr) + R+inr) = 2R+(nr), with #_ and R+ given by 
(2.10). 

Since (13.15) is of the same form as (13.01), the relationships estab- 
lished above for low-pass systems also apply to symmetrical band-pass 
systems, with R{m) replacing P(nr). R{nr) will have the same shape as 
P(nr), but will be greater by a factor 2, which will appear as a multiplier 
in the various expressions and hence not alter the requirements on toler- 
able pulse distortion or intersymbol interference. 

14. TRANSMISSION LIMITATIONS IN ASYMMETRICAL SIDEBAND SYSTEMS 

The formulation of transmission limitations imposed by pulse distor- 
tion in asymmetrical sideband systems is complicated by the presence 
of the quadrature component in the impulse transmission characteristic. 
Of particular interest are the transmission limitations with vestigial 
sideband as compared with double sideband transmission, assuming the 
same bandpass characteristic in both cases, a question which has been 
dealt with in literature for systems with a linear phase characteristic .' 
Relationships (2.18) and (2.19) facilitate a comparison also for systems 
with phase distortion, as shown in the following. 

If the envelope of the impulse characteristic with double sideband 
transmission is P(t), the in-phase and quadrature components with 
vestigial sideband transmission are given by (2.19), with u v = a, or 

R = fl_ + R+ = cos («,< - *.) P(t), 

(14.01) 
Q = Q- - Q+ = sin («.« - *.) P(t). 
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If t is so chosen that u 8 t — ip, = 0, and the time with respect to this 
value of t is designated to , then 



R(t ) = cos ccJoPito), 
Q(to) m sin i0 s toP(to). 



(14.02) 



An application of this method to the impulse characteristic shown in 
Fig. 23 for b = 15 radians is illustrated in Fig. 45. 

In order to compare vestigial with double sideband transmission, it 
suffices to evaluate the in-phase and quadrature components at the 
sampling instants. With t = 7r/2w„ =1/4/ s , the in-phase and quadrature 
components at times mr, for m = ±1, ±2, etc., will be as illustrated 
in Fig. 46. 




Fig. 45 ■ — Determination of in-phase and quadrature components of impulse 
characteristic for vestigial side-band transmission. 
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With double sideband transmission, pulses would be transmitted at 
the points m = 0, ±2, ±4, etc. At these points the quadrature com- 
ponents vanish, as indicated in the above figure, and the in-phase com- 
ponents are the same in amplitude as with double sideband transmission. 
Thus, if pulses were transmitted at the same rate as with double side- 
band transmission, the sum of the absolute values of the in-phase com- 
ponents at the sampling points would be identical with the sum of the 
absolute values of the envelope with double sideband transmission. It 
follows from the criteria established in Section 13 that for this particular 
pulse transmission rate the effect of pulse distortion would be the same 
with both transmission methods. With an ideal transmission frequency 



TRANSMISSION 

FREQUENCY 

CHARACTERISTIC 




P(t) = ENVELOPE OF IMPULSE CHARACTERISTIC 

R B IN-PHASE COMPONENTS AT SAMPLING INSTANTS 

Q = QUADRATURE COMPONENTS AT SAMPLING INSTANTS 

T =1/Cy s = PULSE INTERVALS WITH DOUBLE SIDE BAND TRANSMISSION 

Fig. 46 — In-phase and quadrature components of impulse characteristic with 
vestigial side-band transmission. 
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characteristic having a linear phase shift, there would be no intersymbol 
interference with either method for the above rate of pulse transmission. 

Assume next that the pulse transmission rate is doubled and that the 
quadrature component is eliminated. This is possible if the carrier fre- 
quency is transmitted and is derived at the receiving end with the aid 
of niters and applied in proper phase to a product demodulator, a method 
known as homodyne detection. At the points m = 1, 3, 5, etc., there 
would then be no quadrature components and no in-phase components. 
The sum of the absolute values of the in-phase components at the other 
sampling points, m = 2, 4, etc., would be the same as with double side- 
band transmission. It follows that the transmission capacity (pulsing 
rate) can be doubled by vestigial sideband transmission if the quadrature 
component is eliminated by homodyne detection, for the same margin 
against excessive intersymbol interference as with double sideband 
transmission. 

An increase in transmission capacity can be realized with vestigial 
sideband transmission without elimination of the quadrature component 
by homodyne detection, although a two-fold increase is then possible 
only if the phase characteristic is linear, as discussed below. Vestigial 
sideband transmission can be employed without transmission of the 
carrier, or with a fixed level of carrier in the absence of pulses and a 
higher level in the presence of pulses. The latter method is equivalent 
to the transmission of two or more pulse amplitudes, "with the minimum 
amplitude greater than zero. With this method the effect of the quadra- 
ture component on the envelope of a pulse train can be reduced, and 
even eliminated provided the phase characteristic is linear. In the follow- 
ing, vestigial sideband transmission with two pulse amplitudes at twice 
the double sideband pulsing rate is discussed, for the case in which the 
minimum pulse amplitude is finite rather than zero. 

With pulses transmitted at twice the double sideband rate, i.e., with 
the interval between pulses equal to r = t/2co s , equation (12.08) for 
the envelope becomes in view of (14.02) 

W(0) 

• oo -12 T oo -|2\ 1/2 

£ A n cos u.nTPinr) + £ A» sin ^n T P{nr) J (14.03) 

At the even sampling points, i.e., n = 0, 2, 4 • • • , cos wjit = ±1 and 
the in-phase components may be written 

R(±2mr) = ±F(±2tot), m = 0, 1, 2 • • • 

At the odd sampling points, i.e., n = 1, 3, 5 • • • , sin u.jit = ±1 and 
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the quadrature components may be written 

Q[±(2m - l)r] = ±P[±(2m - 1)t], m = 1, 2, 3 
Let 

2> + = E [tf + (2mr) + # + (-2mr)], 

77.-1 

IX = E [«"(2mr) + i?"(-2mT)], 

(14.04) 

EQ + = E Q + t(2m - l)r] + Q + [-(2m - l)r], 

m— 1 

EQ" = E Ql(2™ - Dt] + Ql ~(2m - 1)t], 

m-1 

where R + , Q + designate positive values and R~, Q~ the absolute values 
of negative amplitudes of the in-phase and quadrature components. 

Let it be assumed that two pulse amplitudes are employed, A min and 
A m ax • When the minimum amplitude is transmitted, the maximum value 
of the envelope is obtained by considering the maximum positive over- 
laps of the in-phase components in conjunction with the maximum value 
of the quadrature component. The value thus obtained is 

W ma * = [(A mla R(0) + A mBX IX) 2 

+ (A max ZQ- - A min ZQ + )T 

It is assumed that J^Q~ > EQ + > otherwise Q~ and Q + would be inter- 
changed in the last term. 

When the maximum amplitude is transmitted, the minimum value of 
the envelope is obtained by considering the maximum negative overlaps 
of the in-phase components, in conjunction with the minimum value of 
the quadrature component, which gives 

F mi „ = [(A max R(0) - A max 2X) 2 + A 2 min (EQ~ 

- E<rtr. (14 ' 06) 

The margin for distinction between A m i a and A max is M = W m i n — 
TTmax and becomes 

M = A mn [(22(0) - E*T) 2 + m 2 (EQ + - EG! 2 ] 1 ' 2 

- A m „ [(mB(o) + E^ + ) 2 + (EQ- - mEo*) 2 ] 1 ' 2 , 

where 

/i = -Amin/^max • 



■ 



THEORETICAL FUNDAMENTALS OF PULSE TRANSMISSION 



1001 



The margin for a unit difference A max — A m - la , i.e. Mi = M/(A maK 
— A m i„) becomes: 

Miss r=r; imo) ~ S/r)2 + " 2(Sq ~ - Sq+)2]1/2 (14.08) 

- [(ixR(0) + IX) 2 + (Eor - mZq + ) 2 ] 1/2 ). 

The special case of an ideal transmission characteristic as shown in 
Fig. 47 will be considered first. In this case 

«(0) = 1 R(2t) = R(-2t) = 

B(4t) = #(-4t) = 

Q(t) = 0.5 Q(-t) = -0.5 
<2(3r) = Q(-3r) = 

so that: 

Y.R + = o *£r~ = 

T,Q + = 0-5 EQ" = 0.5 
Equation (14.08) in this case simplifies to 
1 



M J = 



1 - 



» + i 



! <■ - .>']"). 



(14.09) 



1 - M 
For various values of n = A m i n /A max the margin for unit difference in 
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Fig. 47 — Envelope of idealized impulse characteristic. 






1002 THE BELL SYSTEM TECHNICAL JOURNAL, JULY 1954 

pulse amplitudes becomes: 



Mi. 






0.2 
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0.69 
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Thus, for an ideal impulse characteristic as assumed above, the 
quadrature component gives rise to 50 per cent maximum intersymbol 
with n = 0, and to negligible intersymbol interference when n ^ 0.8 or 
greater. By way of comparison, the margin would be zero with double 
sideband transmission at the rate assumed above, i.e., twice the normal 
double sideband rate. This follows from (13.07) when it is considered 
that P(±t) = }4 -P(O), jP(±2t) = 0, so that the sum of the absolute 
values of the impulse characteristic at the sampling points is equal to 
P(0) and thus M/M mftX = 0. 

Elimination of the effect of the quadrature component by the above 
method is contingent on a symmetrical impulse characteristic, i.e., 
P(m) = P(— nr), a condition which can be realized only with a linear 
phase shift. Furthermore, the in-phase components must vanish at the 
sampling points, which entails an ideal amplitude characteristic. In the 
presence of phase distortion the effect of the quadrature component 
cannot be eliminated but may be reduced by proper choice of the ratio 
H, as discussed below for a transmission characteristic with moderate 
phase distortion. 

As an example consider an impulse characteristic as shown in Fig. 23 
for b = 5 radians. The in-phase and quadrature components at the 
various sampling points are in this case 

R(0) = 0.97 R(-2t) = -0.09 fl(2r) = 0.13 

R(-4r) S R(4t) s o 

Q(_ T ) = -0.54 Q(t) m 0.44 

Q(-3r) ^0 Q(3t) = -0.03 

Q(-5r)^0 Q(5r)^0 

Hence 

D^ + = 0.13 2X = 0.09 £<2 + = 0.44 £<T = 0.57 
Equation (14.08) in this case becomes 

Mi = r-i- ((0.88 2 + 0.13V 2 ) 1 ' 2 - [(0.97/x + 0.13) 2 

1 — jU 

+ (0.57 - 0.44 M ) 2 ] 1/2 ). 
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For various values of n = A m i n /A max the margin for unit difference in 
pulse amplitudes becomes 

n 0.2 0.3 0.4 0.5 0.6 0.7 0.75 

Mi 0.30 0.375 0.40 0.375 0.34 0.25 0.13 

The optimum condition is thus in the above particular case obtained 
with m = 0.3, with a comparatively small variation in transmission per- 
formance for any value of n between and 0.5. • 

In the above discussion of vestigial sideband transmission, modulation 
of a carrier was assumed, with elimination of one sideband except for the 
wanted vestige. The equivalent performance can be secured by applica- 
tion of impulses to a band-pass transmission characteristic with the 
proper interval between pulses in relation to the midband frequency, as 
discussed below: 

When equation (12.03) is written with respect to the midband fre- 
quency, o) r = 03 m , and a symmetrical amplitude characteristic is assumed 
so that Q = 0, the following relation obtained. 

OO 

W (t ) = cos o) m t 22 ^n cos co m nrR(t + nr) 

(14.10) 
— sin O3 m t 52 ^n s i n o» m nrR(.to + nr), 



in which R may be replaced by P, the envelope of the impulse charac- 
teristic. 

Let it be assumed that t is so chosen that cos u m riT = cos nir/2 in 
which case sin co„nr = sin mr/2. The above equation then becomes 

OO 

W(lo) = cos a>Jo X) A n P(t + nr) cos wtt/2 

n=— oo . 

(14.11) 
— sin co m / J2 A n P(k + nr) sin mr/2. 

n— oo 

The in-phase and quadrature components of the envelope at the sampling 
instant t = are accordingly 

CO 

#(0) = 12 A n P(riT) cos nir/2, 

T _ < 14 - 12 > 

<K0) = 52 A n P(nr) sin mr/2. 

n=— oo 

Pulses in even positions, i.e., A , At , A A , etc., will thus contribute an 
in-phase but no quadrature component while pulses in odd positions 



I 
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A\ , A 3 , A 6 , etc., will contribute a quadrature but no in-phase com- 
ponent. It will be recognized from Fig. 42 that this is the same condition 
as encountered in vestigial sideband transmission with pulses in the 
latter case transmitted at intervals t = 7r/2co. = 1/4 /. . 

To realize the above condition with pulses applied to a band-pass filter, 
it is necessary that in (14.10) 

co ro nr = mr(y 2 + JV), (14.13) 

where N is an integer, or that 

_ x(l + 2JV) _ 1 + 2N (1414) 



T = 



2a m 4/„ 



The interval between pulses must thus be an integral number of half- 
cycles plus one quarter cycle of the midband frequency f m , as illustrated 
for a particular case in Fig. 48. When f m is large in relation to the side- 
band frequency this condition can be achieved with substantially the 
same pulse spacing as with vestigial sideband transmission. To secure 
exactly the same rate of pulse transmission it is necessary that 

r= 1/4/., 

which, in conjunction with (14.14), gives 

N = | (/«.//. ~ 1). (14.15) 

Thus, if /„, = 5/. , N = 2 and the interval r between pulses as obtained 
from (14.14) is 1.25 cycles of f m . If /„ = 10/ 8 , iV = 4.5 and it is not 
possible to have exactly the same pulsing rate as with vestigial sideband 
transmission, since N must be an integer. It is then necessary to take 
N = 4 or 5. With JV = 4 equation (14.14) gives r = 9/40/„ and with 
iV = 5, t = 11/40/. . This compares with r = 1/4/. = 10/40/. with 
vestigial sideband transmission, so that there is a minor difference in 
pulse intervals with the two methods. 

15. DOUBLE VERSUS VESTIGIAL SIDEBAND SYSTEMS 

From the preceding discussion it follows that, for the same bandwidth 
and margin against interference from characteristic distortion, a two- 
fold increase in transmission capacity can be approached with vestigial 
over double sideband transmission. This assumes that the carrier is 
transmitted at the proper level and that the phase characteristic is 
linear, or that otherwise homodjaie detection is used to cancel the effect 
of the quadrature component. 
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For the same bandwidth, the same transmission capacity can be 
realized with a double sideband system employing four pulse amplitudes 
as with a vestigial sideband system with two pulse amplitudes. However, 
the latter type of system will have a greater tolerance to interference 
from characteristic distortion than the former. This follows when it is 
considered that in a quaternary system the maximum tolerable inter- 
ference is ^e the maximum pulse amplitude, as compared to \4, the maxi- 
mum pulse amplitude in a binary system. With \i = A m \ n /A mBX . = 0, 
the quadrature component reduces the margin by a factor of 0.5, so that 
the maximum tolerable interference in relation to the maximum pulse 




PULSE TRANSMITTED IN POSITION fl = -1 



PJLSE TRANSMITTED IN POSITION n = 1 

* RESULTANT ENVELOPE 

Fig. 48 — Impulse exitation of band-pass sj'stem with pulse spacing selected 
to provide equivalent of vestigial side-band transmission. 
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amplitude is M & s compared to l /& for a quaternary system. If the phase 
characteristic is linear and the carrier is transmitted at the optimum 
level, or if homodyne detection is used, the effect of the quadrature com- 
ponent is cancelled. The maximum tolerable interference is then V£ as 
compared with % for a quarternary double sideband system. 

In the presence of phase distortion, a substantial advantage can also 
be realized with a binary vestigial system, which can be illustrated by 
considering the example in Section 14. For the optimum condition /x = 
0.4, the margin is reduced by a factor 0.4 and is thus 0.2. For a quater- 
nary double sideband system the factor by which the margin is reduced 
is given by (13.07), with q = 4 and with 

4|ifwi+iwi=^E^+2;n 

where R(0) = 0.97, J^R + = 0.13 and Y,R~ = °°9> as in the example 
in Section 14. The reduction in margin thus obtained is M/M max = 
0.32. Hence the maximum tolerable interference for a quarternary double 
sideband system is 0.32/6 = 0.053 as compared with 0.20 for a binary 
vestigial sideband system under the optimum condition // = 0.4. 

For the same transmission capacity and same number of pulse ampli- 
tudes, a substantial transmission advantage may be realized with ves- 
tigial over double sideband transmission in circuits with pronounced 
phase distortion, owing to the circumstance that a two-fold reduction 
in bandwidth with vestigial sideband transmission may afford a sub- 



-^AMPLITUDE CHARACTERISTICS 




FREQUENCY 



DELAY DISTORTION 



'MAX 'I d MAX f MAX - 0-15 (JmaX^MAX 

Fig. 49 — Comparison of double and vestigial side-band transmission in the 
presence of delay distortion. 
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stantial reduction in delay distortion over the transmission band. This 
is illustrated in Fig. 49, where a cosine variation in transmission delay 
is assumed. With a two-fold reduction in bandwidth, the product 
d'max/'max for vestigial sideband transmission is about 15 per cent of the 
product dmaxfmax for double sideband transmission. Thus, with d max f max 
= 8.3, d'max/'max = 1-25, corresponding to b = 5 radians, as assumed in 
the example in Section 14. Vestigial sideband transmission is in this case 
feasible with an adequate margin, about 40 per cent of the maximum 
margin in the absence of phase distortion. Double sideband transmission 
would not be possible, as is evident from Fig. 43, since it would be neces- 
sary to have d max f maK less than 4, as compared with 8.3 in the above case. 
The above discussion of vestigial vs double sideband transmission 
pertains to the effects of characteristic distortion rather than noise, and 
the relative complexity of terminal equipment was disregarded. Because 
of the simpler terminal equipment with double sideband transmission, 
this method is ordinarily used where bandwidth is not a primary con- 
sideration, as for example in providing a number of telegraph' channels 
over a voice frequency circuit. 

16. LIMITATION ON CHANNEL CAPACITY BY CHARACTERISTIC DISTORTION 

For an idealized channel of bandwidth /i with a transmission-frequency 
characteristic as shown in Fig. 7, the transmission capacity in bits per 
second for a signal of average power P in the presence of random noise 
of average power N can with sufficiently complicated encoding methods 
approach the limiting value given by Shannon: 12 

C = /i log 2 (1 + P/N). (16.01) 

The above expression also applies to certain other idealized channels 
with a linear phase characteristic, when /i is defined as in Fig. 10. In all 
of these cases the integral of the area under the amplitude characteristic, 
or the equivalent bandwidth, is /i . 

By way of comparison, for pulse code modulation systems the channel 
capacity is of the same basic form as (16.01), namely 13 : 

c-/ika(i + £pV (16.02) 

where K = 8. Thus about an 8-fold increase in signal power is required 
to attain the same channel capacity as with the idealized but imprac- 
ticable encoding system underlying (16.01). 

The above expressions give the limitation on channel capacity imposed 
by random noise. From the discussion in Sections 13 and 14 it follows 
that a limitation is placed on channel capacity by characteristic distor- 
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tion, in the absence of noise. In idealized communication theory, charac- 
teristic distortion has been disregarded in determining channel capacity 
on the premise that unlike random noise it is predictable and can there- 
fore be corrected, at least in principle. In actual systems, however, com- 
plete elimination though possible in principle cannot be accomplished in 
practice. The resultant limitation on transmission capacity may be as 
important as that imposed by the maximum signal power that can 
actually be provided to override noise. 

In the following it will be assumed that correction of amplitude and 
phase deviations is made by equalization, so that the amplitude and 
phase characteristics are as assumed for an ideal channel, except for 
small fine structure residual deviations as illustrated in Fig. 30. These 
small fine structure deviations may be regarded as of random nature in 
the sense that they differ among channels and cannot be predicted, 
although for a given system they would remain fixed in the absence of 
temperature variations or changes in amplifiers with age. 

From equation (13.12) it follows that the maximum number of pulse 
amplitudes or quantizing levels as limited by characteristic distortion is 
obtained from the relation 

1 = kUA/A mM , (16.03) 



q- 1 
or 

q - 1 + j-rj A ma JA. (16.04) 

In the absence of characteristic distortion, the maximum number of 
pulse amplitudes as limited by an rms noise amplitude An or a peak 
noise amplitude kA n is obtained from the following relation for a bal- 
anced pulse system. 

- kA n , (16.05) 



q- 1 



or 



q = i + A. A max /A. (16.06) 

kA n 

Comparison of (16.04) and (16.06) shows the following equivalence 
between intersymbol interference and noise from the standpoint of 
limitation on the permissible number of pulse amplitudes 

U = A„/A, (16.07) 
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or 

U°- = D = N/P. (16.08) 

This means that random characteristic distortion has the same effect 
as a random noise power N = DP, where D is a distortion factor. 

In view of the above equivalence, the channel capacity of a PCM 
system in the presence of random characteristic distortion, but without 
noise, as obtained by substitution of (16.08) in (16.02) becomes 

C-/ 1 log 2 (l+~V (16.09) 

With random interference from both characteristic distortion and noise, 
the interfering powers add directly, so that for a PCM system 

e -**»( l+ x&brm )- (mo) 

The equivalence (16.08) was established above on the basis of discrete 
pulse amplitudes, but it is independent of q and would thus apply also 
for continuous signals. On this basis it would apply for any method of 
modulation or of encoding signals and the maximum channel capacity 
as given by (16.01) would be modified to 

C = '' los *( 1 + I7+W)' (16 - U) 

It follows from the above that for any modulation method the toler- 
able distortion factor is directly related to the average signal-to-noise 
ratio. Thus two modulation methods which are equivalent from the 
standpoint of signal-to-noise ratio are also equivalent from the standpoint 
of tolerable rms distortion, provided faithful reproduction of the trans- 
mitted signal is required, as assumed here. 

From (8.14) the following relation is obtained between the distortion 
factor D = U 2 and small rms deviations a (nepers) and 6 (radians) in the 
amplitude and phase characteristics 

D = a 2 + b\ (16.12) 

In order that characteristic distortion may be disregarded in compari- 
son with noise, it is necessary that D <£ N/P or 

a 2 + V « N/P. (16.13) 

For example, in communication systems employing the same band- 
width as the original signal, such as a pulse amplitude modulation sys- 
tem, a representative signal-to-noise ratio would be about 40 db, or 
N/P = 10~ 4 . In order that characteristic distortion may be disregarded 
in this case, it would be necessary for both o, and b to be substantially 
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less than 10 -2 nepers and radians respectively. This would correspond to 
an rms gain deviation over the transmission band well below 0.08 db 
and an rms deviation from a linear phase characteristic well below 0.6 
degrees. Since these tolerances are difficult to realize in actual systems, 
at least for wire circuits, characteristic distortion rather than noise may 
impose a limitation on channel capacity of systems employing about the 
same bandwidth as the original signal. 

In accordance with (16.01), the bandwidth can in principle be halved 
without change in channel capacity if the signal-to-noise ratio is squared, 
i.e., if N/P = 10~ 8 rather than 10~ 4 in the previous example. The toler- 
able rms amplitude and phase deviations would then be 

a 2 + 6 2 « 10" 8 . 

Thus both a and b would have to be substantially smaller than about 
10 -4 , which would preclude a substantial bandwidth saving in practical 
systems from the standpoint of characteristic distortion, even if it were 
feasible from the standpoint of signal power required to override noise. 
The above considerations apply when faithful reproduction of the 
transmitted signal is required, as for example in data transmission. In 
speech transmission considerable distortion can be tolerated, a circum- 
stance which permits appreciable phase distortion in the usual frequency 
division system without noticeable impairment of intelligibility, but 
which cannot be taken advantage of in time division pulse systems be- 
cause of the resultant intersymbol interference. The characteristics of 
speech sounds also permit a reduction in the bandwidth of the original 
transmitted signal, by such devices as vocoders or frequency compandors, 
without excessive impairment of intelligibility. 
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